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900 

Positional stimulus point for element 
creation is clicked or touched. 



301 



902 

Location for new element input 



904 

Threshold is set to desired level. 



906 

ECM generates new audio element. 
908 

Audio is received. 

I 

910 

Received audio is embedded in the audio 
data field of the element. 



YES 




920 

Recording stopped until audio above 
threshold is received 



916 

Element Creation Module passes 
completed element to Application Module. 



i 



918 

Application Module stores new element in 
memory. 
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Fig. 10A 



1000 

Positional stimulus point for playback of 
intended elemen t is input 

i 



1002 

Application Module draws selected 
element from memory and passes it to the 
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1004 

Playback Module reads audio data from 
audio data field. 


► 

► 










1006 

Audio is output through attached device. 




1 




1008 

As audio element is played, the displayed 
waveform is colored to show sections 
which have been played. 
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End of audio 
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^ ^ 1011 
Isfew audio element button; 
^ - . selected? 
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^ "1012^- 
Stop command 
received? 
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Fig. 10B 




1018 

Identify next audio element 



u 

1020 

Retrieve next audio element and send to 
Playback Module 
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1102 

Join operation, first audio element and second 
element are selected 

I 

1106 

Application Module retrieves selected elements from 
memory. 

i 

1108 

Elements are passed to joining module. 
1112 

Joining Module retrieves audio data from second 
audio element. 

j 

1114 

Joining Module appends retrieved audio data to 
existing audio data in the first audio element. 

i 

1116 

Joining Module moves links from second audio 
element to the first audio el ement. 

i 

1118 

Joining Module modifies the ordinal value of the first 
element if necessary 

i 

1120 

Joining Module passes the new audio element to the 
application module. 

1122 

Application Module updates memory, delete second 
audio element and adjusts ordinal values of remaining 
audio elements. 
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Fig. 12 
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1200 

Select the element to be split and a split point. 



I 



1202 

Positional stimulus point for the splitting function is 
clicked or touched. 



i 



1204 

Application Module retrieves designated element from 

memory. 



1206 

Application Module passes designated element and 
split point to Splitting Module 



1208 

Splitting Module reads audio data from designated 
element. 



1212 

Splitting Module creates a second audio element and 
moves audio data after the split point to the second 
audio element 



i 



1214 

Splitting Module creates new link objects for second 
audio module and modifies link objects for designated 
audio element 



1216 

Splitting Module passes new audio element to 
application module. 



i 



1218 

Application module updates memory, and adjusts 
ordinal values of remaining elements. 
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Fig 1 3 



1300 

Positional stimulus point for the linking function 
is clicked or touched. 
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1302 

Selection Operator is applied to element to be 
linked, desired temporal range, and desired 
external content object and a range 



i 



1304 

Application Module retrieves designated 
element and object from memory. 



1306 

Application Module passes designated 
element, designated object and ranges to 
Linking Module 



1308 

Linking Module creates a link object, embeds 
ID for audio element, ID for external object, and 
ranges 



1310 

Linking Module passes link object to 
Application Module. 

i 

1312 

Application Module updates memory. 



1314 

A connector representing the link object is 
displayed between icons representing audio 
element and external object. 
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1400 

Display a plurality of audio elements 



y 

1402 

Positional stimulus point for reordering is 
clicked or touched. 

i 

1404 

Plurality of audio elements selected for 
reordering and order is input 

i 

1406 

Application Module retrieves selected audio 
elements from memory and passes them and 
an order to the Reordering Module. 



j 

1408 

Reordering Module reads the ordinal number 
fields from the selected audio elements. 



I 

1410 

Determine the lowest ordinal value for the 
selected audio elements. 



| 

1412 

Reorder selected audio elements using lowest 
ordinal value and the input order. 
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•YES 



NO 

JL 



1420 

Reordering Module passes the reordered 
audio elements and link objects back to the 
Application Module 



1422 

Application Module updates memory with the 
reordered audio elements and display 
updated. 



y 

Q END ^ 
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Fig. 14C 




1426 

Identify unselected audio elements 



J 

1428 

Determine ordinal number of unselected audio 
elements 

7 ~ 

1430 

* Reorder unselected audio elements having an 

j; g ordinal value greater than the lowest ordinal 

1 3 value of the selected elements 
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